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Abstract 

We characterize the existence of the Lebesgue integrable solutions 
for the truncated problem of moments in several variables on un- 
bounded supports by the existence of maximum entropy - type rep- 
resenting densities and present a new technique to compute them. 
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1 Introduction 

In this work we consider the problem of moments in the following context. 
Let T C M" be a closed subset, where n G N is fixed. Let / C (Z+)" be finite 
such that G /, where Z+ = M U {0}. Fix a set g = {gi)i£i of real numbers 
Qi with qq = 1. The problem under consideration is to establish if there exist 
(classes of) Lebesgue measurable functions / > a.e. (almost everywhere) 
on T, such that Jj^\t^\ f{t) dt < oo and 

[ff{t)dt = g, (tel) (1) 
Jt 

and find such solutions /. As usual dt = dti . . . dtn and f = ■ ■ - t^n 
any multiindex i = (ii, . . . , z„) G where t = (ti, . . . , t„). In this case we 
call / a representing density for g, and gi the moments of /. In general T is 
unbounded and usually I = {i : \i\ < 2k} for k E N, where \i\ = ii + ■ ■ ■ + in- 
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Generally a problem of moments [2S], called also T -problem of mo- 
ments [TT] when T is given, is concerned with the existence of an arbitrary 
Borel measure /i > supported on T such that Jrpfdfi{t) = gi for i E I, 
in which case one calls /i a representing measure of g. The feasibility of ([1]) 
characterizes the dense interior of the convex cone of all data g having repre- 
senting measures, provided that alH G T are density points and / is a union 
of intervals [0,i] := { j G : < jk < ik, ^^k<n}, see [Theorems 5, 6, [2]] 
(and [Theorem A.l, [16]], in a slightly different context). For our purpose 
here we only require that the Lebesgue measure of T be 7^ 0. 

By Corollary |6l for each fixed e > we characterize the feasibility of ([1]) 
by the existence of a (unique) minimizing fj, f\n f dt + e frp \\t\\'^^'^^ f (t) dt 
amongst all solutions, which is equivalent to the existence of a (unique) 
vector A* = (A*)|i|<2fe maximizing the associated Lagrangian L{\) = L^{X) = 

E|i|<2fc^i^»-/Te^'''-''^'*'~'"*"''^'^^' in which case f^{t) = e^N<2'= 
where = (X^j=i t|)^''^- The more general formulation of the main result 
Theorem H] aims to cover also other cases like T =compact with e = [20] . 
CorollarylHsuggests a way of finding A* without computing multiple integrals. 

Maximizing the Boltzmann-Shannon's entropy H{f) = — J^f In f dfi on 
a probability space (T, /x) subject to various restrictions f^ai dfj, = g^ {i E I) 
is a well-known principle in statistical mechanics and information theory [10], 
|15] . [16], [21]. The maximum of H is attained on the unbiased probability 
distribution /* on a partial knowledge, of the prescribed average values g^ of 
some random variables [B] , [ID] , [U] • Typically is obtained by maximizing 
a function L (the Lagrangian) convex conjugate to —H [7], [B], [IB], [22], [25], 
which leads to characterizations (sup/max L < 00) of the feasibility of the 
primal problem -in our case ([1]). One may consider more general measures 
/i > or functionals like H{f) = — tr(/ln/), tr(ln/) where / = positive 
definite matrix for noncommutative moments [Theorems 2,3, [5]], [5]. 

While the case T =compact was known long before [20], the similar prob- 
lems with unbounded support T (or unbounded moments a,) are usually 
difficult, still studied in recent years [6], [9], [16], [18], [19]. If T is un- 
bounded. Corollary [6] cannot be improved to e = 0: there are examples of 
realizable, but degenerate data g such that the constrained if-maximization 
fails for (T, fi) = (M", dt) [IB]. For H{f) = — / In / dt, the maximization 
of L{X) (= Lo(A) G [— cxD,oo)) always holds, at a unique point A* - using 
for instance [Corollary 2.6, [7]], see also [H], [IB]. It follows, by means of 
Fatou's lemma, for I = {i : \i\ < 2k}, that \f\e^\j\<^'' ^P' g L^{T,dt) for all 
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\i\<2k, Jr^fe^\^\^^''^^*'dt = gi {\i\<2k) but the equality may fail for \i\ = 2k. 
Namely the dual attainment sup L = max L does hold, but primal attainment 
supyg|jj = max^g|Yj is also a difficult topic if ai(t) (for instance 

P) are not in the dual of L}{T). For these well-known facts, see [TB], [TB] . 

Originated in works by Stieltjes, Hausdorff, Hamburger and Riesz, the 
area of moments problems saw extensive development in many directions that 
we do not attempt to cover. There are also other approaches to the multi- 
variate moments problems, by operator theoretic or convexity methods [12], 
^13j . [H], [21], [27], [2H], we mention a truncated version of Riesz-Haviland's 
theorem [11], see also [17], [23] for other results, related to sums-of-squares 
representations of positive polynomials or polynomial optimization theory. 
These interesting topics are beyond the goal of this paper, that is focused on 
the H / L - maximization. 

I express my thanks to professor Marian Fabian for drawing the results of 
the Fenchel duality theory to my attention. Also, I am indebted to professor 
Mihai Putinar for several interesting suggestions and relevant references. 

2 Main results 

Fix T, / and g as stated in the Introduction. For any measurable space 
T endowed with a cr-finite measure /i > and 1 < p < C)0, the notations 
LP{T,fJ,), LF^{T,h) (sometimes, L^^fi), L^{fi)) have the usual meaning. We 
repeat below an argument from [Theorem 2.9, [7]], adapted to our case. 

Lemma 1 (see [7J) Let >0 be a finite measure on T. Let x G L^(/i) \{0}, 
and ai G L^{fi) (i E I) be a finite set of functions such that Jj- \ ai\xdfi < oo 
for all i and (aj)i are linearly independent on any subset of positive measure. 
Then there is a sequence {yk)k>ko C L°°{fi) such thatxk := min(x, k)+yk > 
a.e., f^aiXkd^ = f^aixd^ for alii G /, < x and y^ — )■ a.e. 

Proof Set Zk = mir(x,k) for A; > 1. Using {x > 0} = U;>i{x > 1//}, 
we find a 5 G (0, 1) and % C T with fi(Tl) > such that x(t) > S 
a.e. on %. The linear map A : L°°{%) — )■ (A^ = card/). Ay = 
il% '^iV is surjective for otherwise there is a (Aj)j 7^ orthogonal to 
its range, such that Ir ^iV^f^ = ^'^U^ whence AjOi = a.e. on 

% that is impossible. Since A has closed range, there is a c such that 
inf^gker A lb — "U^lloo < c||y4?/|| V y G L°° {%) . By Lebesgue's theorem of 
dominated convergence, lim^ jlj-aiZkdfi = j^aixd^ for all i. There are 
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yk G L°°{'T) with suppt/fc C % such that f^aiUkd^ = f^ai{x — z^) djji and, 
since Ay^ — i- 0, we can choose them such that |||/fc||oo ~^ 0. For large k, 
WVkWoo < 5/2. On %, X > min(x, k) > 6 > 6/2 > \yk\. Then a;^ > a.e. □ 

Fenchel duahty deals with minimizing convex functions : X — )■ (— oo, oo ] 
over convex subsets of locally convex spaces X in connection with the dual 
problem of maximizing —(p* where (p* is the convex conjugate of (p, called 
also its Leg endre- Fenchel transform [7], [25], [22], [8], [18]; ip must be proper 
{ip ^ oo). Letting the effective domain oi ip be dov[i(p = {x G X : (p{x)<oo}, 
(p* is defined on the dual of X by (p*{x*) = sVi\i{{x,x*) —(p{x) : x G domc^?}. 
Typically, inf = sup(— y?*). Briefly speaking, one sets fpi^x) = —H{x) if 
X > satisfies the equations of moments, and (p{x) = +oo outside the set of 
solutions. Then (p is convex conjugate to ip*{x*) = In J^e^*'^''^' d/i — Yliidi'^i 
for X* = Ajflj, and <y9*(x*) = +oo otherwise. Thus domy)* is the linear 
span of the a^'s and (if Qq = 1) the Lagrangian / := —ip*\domip' is given 
by A I— 7- — In e^'e/\{o} Maximizing / or L are equivalent prob- 
lems. We rely on J.M. Borwein and A.S. Lewis' Theorem [2] from below 
[7] concerned with L, providing dual attainment in a point A*. The equal- 
ity inf = sup(— <y9*) becomes here P = D. Although under different hy- 
potheses, L is analogous to the dual function ip from CD. Hauck, CD. 
Levermore and A.L. Tits [Section 4.1, [H]], and would fit the case when 
dom L n d{dom L) = in M. Junk [TB] except we do not have here a distin- 
guished moment such that lim , ^"''-^IL = (i^m). 

Theorem 2 [Corollary 2.6, [7]] Let T be a space with finite measure > 0, 
1 < p < oo and ai G L'^[ji), gi & M. for i E I (= finite) where ^ + ^ = 1- 
Let : M — )■ (—00,00] he proper, convex and lower semicontinuous, with 
(0,00) C dom0. Suppose there exist x G ^^^(yu) with x{t) > a.e. such 
that (j) o X E L^{fi) and J^ai{t) x{t) dn{t) = gi for i E I. Then the values 
P G [—00, 00) and D G [—00, 00] defined respectively by 



P = 'mi{ (f){x{t)) dfi{t) : X EL^{fi), X > a.e., (jx:>x E L^{fi), aixdfi = gi^i} 



D = max{'^gi\i - / (p* \iai{t)) dfx{t) : A, G M, 0*o^Aiai G L\fi) } 





and 




are equal, —oo<P = D<oo and the maximum D is attained. 
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Remarks 3 (a) Let be defined by = xlnx for x > 0, 0(0) = and 
0(x) = +00 for X < 0. Then is proper, convex, lower semicontinuous, 
bounded from below, with effective domain [0, oo) and its convex conjugate 
is (f)*{y) = e^~^ for all G M; use to this aim that 4>*{y) = sup^yQ^xy — xlnx). 

(b) For the integrand defined at (a) and (Aj)jg/ = 0, the constant 
function {4>* = is in L^{fi). Thus for any data Oj, gi 
verifying the hypotheses of Theorem [2], we obtain that — oo < P = D < oo. 

(c) Let X G L\{ii) with xlnx G L^{lj) and yu G L^^p) {k > 1) such that 
Xk '■= min(x. A;) + |/fc > a.e., \yk\ < x and — )■ a.e. as A; — )■ oo. By 
Lebesgue's dominated convergence theorem, lim^ / XklriXkdfi = f xlnx dfi, 
since on {t:Xk{t)>l}, Xk<2x ^ lnxfc| < |2x ln(2x)| while on {t : Xk(t) < 
1}, Inxfcl < 1/e; hence Inx^l < |2x Inx + (2 ln2)x| + 1/e G L^{p)- 

In Theorem m the choice of the norm on MJ^ is unimportant. We call a 
function a on T independent of (t*)jg/\{o} if there are no subsets Z C T of 
positive measure and constants (cj)ig/\{o} such that ct = X]ie/\{o} '-i^* '^^ ^■ 

Theorem 4 Let T C M" be closed, / C Z" finite, G / and g = {gi)i^i a set 

of numbers with go = l. Set m = maxjg/|i| . Let a, p be measurable functions 

iitir+i 

onT, < a, p < oo a.e., such that e p{t) dt <oo for all a>0 and a is 
independent o/ (f)jg/\{o}- The statements (a), (b), (c) are equivalent: 

(a) There exist functions f G L\{T,dt) such that Jj, \ f\f{t)dt < oo and 



(b) There exists a particular solution G L\(T, dt) of problem (|2]), max- 
imizing the entropy functional H = Hp a '■ L^{T,dt) — )■ [—00,00) given by 



amongst all solutions; 

(c) The Lagrangian function L = Lp^a,g '■ — ^ [—00,00) (N = card/j 
associated to the functional H and the equations ([2]), given by 



is bounded from above and attains its supremum in a point X* = (A*)ig/. 




{^ G /); 



(2) 





(A = (A,),e/) 
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In this case and X* are uniquely determined, —H{f^) = L{X*) and 
Uit) = a{t)-'p{t) eS>.^^»**"/'^W-i {t e T), 
in particular H ^ — oo on the set of all solutions of ([2]), and 

j fe^^^^'^'^'''\{ty^p{t)dt = gi {te I). 

Proof. Let ai{t) = f/a{t) for i E I and t E T. The condition on p 
and a shows that the measure p := p dt on T is finite and, by means of the 
inequahties: \tj\ < \\t\\ (:= (EJ=i^j)^^^) 1<J<^, 



|f I = \t\' . . .4-1 < < + < + 1 (3) 

and XliG/ < Eie/ l-^^l ' "^l^t^ ' ^^^^ ^^^^^ ^ (-^i)ie/ G 

^(A) := j e^>e/^.'^»W~ic;^(t) < 00. (4) 

By writing se'/" < e^^/° for large (3 (> a/e + 1) and s := {\\t\\"^ + l)/a{t), 

+ l iiiir+i 

e < 00 (« > 0). (5) 



a{t) 

Then for every A = (Ai)jg/, by the inequahties ([3]) again, 

y (||t|r + l)a(t)-^e^'e^^»'^'W-M/i(t) < 00. (6) 

Hence Jrpai{t)e^iei ^i"-i(^)-^dp(t) < 00, in particular G L^{T,p) for i E I. 
Any of the statements (a) - (c) implies that the Lebesgue measure of T is 
strictly positive (finite or not), due to the condition go = 1. Then for every 
/ E L\(T, dt), by Jensen's inequality for the function := xlna; {x > 0), 

H{f) = -p{T) I <pC-^)^<-p{T)<P{f ^^)<Mr)/e<oo. 
Jt P KT) Jt p P{T) 

(a) =^ (c). Suppose that problem ([2]) has a solution /. The function 
X := af / p then satisfies |aj|a;(i/i < 00 and Jj,aixdp = Qi for i E I. By the 
original version [Theorem 2.9, \T\] of Lemma[T](if Xk = ma.x{x, k)+^+yk), there 
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are functions x G L°°{T,^), x > /i-a.e. on T, such that frpai(t)x{t)dfi = gi 
{i G /). Here L^{T,fi) = L°°{T,dt) since n is equivalent to dt on T. For 
such X, the function (pox = xlnx belongs to L°°{T), and hence, to L}{T,ii). 
Then we can use Theorem [2] for = x Ina; and p = oo, see Remark |3l (a). 
Let P = infj; J^xlnxd/x over the set of all x G L°^{T) such that 

aiX dfi = gi, i E I (7) 



T 



and := sup L. Then — oo < P = D < oo with attainment in the dual prob- 
lem, see Remark[3l (b). Therefore, L(A) = Eie/f^^* " e^^e^ ^^"^^-^//(t) 
is bounded from above on and its supremum D is attained. 

(c) =^ (b). Assume there is a A* such that L{\*) = maxL. As expected, 
we will derivate under the integral to show that := e^^^i ^^""^^^^'^ sat- 

isfies d?]) and moreover maximizes H^{x) := — j[^x In x dfi amongst all solu- 
tions from L\{T,ij,). Firstly, by (g]), J^x^{t)dn{t) = g{X*). By and (0), 
/j. |ai|x*(i/i < oo (i G J). For any A we have L{X) < L{X*), that is, by 

^7(A*)<^?(A) + ^^?,,(A*-A,). (8) 

Fix j G /, let = ±aj{t) and set f = (fi)ie/ where = ±5ij = 

Kronecker's symbol (the signs agree). For any e > 0, set A^ = A* + ev, 
namely A^ = {XEi)iei where X^j = X* ± e and A^j = A* for i ^ j. Let 
F,{t) = Jx*(t)(l - e^^W). Note that 

\imF,{t) = -ipit)x,{t) (9) 
and x*e^^ = e^^^i = e^^^^^'^'-^ Then by (H and ([8]), 

F.(t)rfMt) = '^^^^"'^^-^ < T9r (10) 



T 



By the estimates ([3]), we may let y = ip{t) and z = (||t||™ + l)/a(t) in the 
inequality: e~^^—^ > —\y\ where z > 0, y is real, \y\ < z and e < 1. Hence 
Feit) > -x,{t)\^{t)\ ■ edl^ll^+i)/"^. The right hand side is in L\T, fj.) by 
the estimates: \ip{t)\ < {WtW"" + l)/a(t), x^{t) < e^(ll*ir+i)/»W for a constant 
c = c(A*), and iQ. Then we may apply Fatou's lemma for a sequence 
e = £fc — )■ to obtain, by ([2]) and ffHJ]) . that 



/ ajx^dfi = — / (px^,d^ = / lim Fgfi/i < liminf / Ffrd^<^gj. 
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Hence Jj,ajX^,dfi = gj. Since j was arbitrary in /, x^, is a solution of ([7]). 
The function := px^/a is then a solution of ([2]). By (jl]) and ([0]) , In G 
L^(T,fi), i.e. {af^./p)\n.{af^/p) G L^(T,pdt). Hence there are solutions / 
of 02]) such that H{f) > — oo. By the correspondence / O x = a//p, 
the fact that /* maximizes the functional H given at (b) is equivalent to 
saying that frpX^^lnx^dp < Jj^xlnxdfi for all the solutions x G L\(T,fi) of 
the problem ([7]). By Lemma [T] and Remark [31 (c) it suffices to show that 
JrpX^ lnx*(i/i < jrp X In X dp for any solution x G L'^(T) of ([7]). This holds by 

J xlnx dp> P = D = '^2K9i'~ J e^^^^"''~^dp = J x^^lnx^dp. 

The conclusion P = D oi Theorem [2] provides —H{f^) = L{X*). The 
uniqueness of A* and /* (or, equivalently, x*) follow from the strict convexity 
of —L, resp. —H^ and the fact that T is not negligible, whence p\t = a.e. =^ 
p = for any polynomial p = Yliei ^i-^^ (the zeroes sets of nonconstant 
polynomials are algebraic varieties, and so have null Lebesgue measure). □ 

Proposition [5] develops an idea from L.R. Mead and N. Papanicolaou |2T] . 

Proposition 5 Let T, I, g and p, a satisfy the hypotheses of Theorem 
Suppose also that a = J2iei ^^-^^ '^'^'^ Xlig/ ^i9i > 0- ^up Lp^a,g < oo, then 
there is a X* on which the supremum is attained, snp Lp a,g = Lp^a,g{^*) ■ 

Proof Since a is independent of (t')jg/\{o}) Cq 7^ 0. Set Cjo = Cj, Cij = Sij 
(z G /, j G / \ {0}). A change of variables A t-)- A: Aj = J^jei'^v^i gives 
L(A) = L(A) := Y^jeidf^j - j^e^^^'^'"-'"^ pdt where gj = Y.i&iCtjgt and 
dj = Tj/a for Tj(t) = Then supL = supL. It suffices to prove the 

attainment for L. Denote A, dj, g, L by A, aj, g, L, respectively. Now Oq = 1, 
go > and (Tj)jg/ are linearly independent on any subset of positive measure. 
Also p(T) > since sup L < 00. Set A = (Aq, A') where A' = {\i)ii=i\{o}- Max- 
imizing L with respect to Aq gives a(A') := — In Jj, 6^^^''^^°'^ dp{t) such 
that maxAo L{Xq, A') = L(a(A'), A'). Consider the (convex) potential /(A') := 
j^eE,6A{o}^»K(*)-90f/^(j() so that sup L < cx) <^ inf / > 0. If inf / is attained 
at some A'^, supL will be attained at {a{\[), \[). By ([3]), | X]jg/\{o} '^«('^«(^) ~ 
9i)\ < ||A'||(c^J^ + ||5(||) where ||A'|| =X;ig/\{o} \K\^ WqW = m&Xi^j\gi\ andcis 
a constant. Then for every sequence A'^ = {Xki)i€i\{o} such that lim^ A'^ = A' 
we have e^'eA{o> < e^^PkWKU^^^ +\\9\\) ^ L\T,p). Hence by 
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Lebesgue's dominated convergence theorem, limfc/(A^) = /(A'). Thus / is 
continuous. 

There is no A' 7^ such that px'{t) := Xlie/\{o} '^ii'^ii't) / O'it) — fi'i) < a.e. 
on T, for otherwise on the set Z : pyit) = we have ^jg/\{o} -^ifl'j = 
Eig7\{o} '^i^i(^)! if Eig/\{o} '^ifi'i = 0' W6 set fi{Z) = due to A' ^ 0; if 
EiG/\{o} "^idi 7^ 0' again = since a is independent of (ri)jg/\{o} 

(= (f )ig^\|o})- Then on T \ Z, px'it) < 0, e''P^'(*) < 1 (r > 0) and by 
Lebesgue's theorem, for rk — )■ 00, f{rk\') = Jj,e'^''P^'^^^diJ,(t) which is 
impossible since inf / > 0. Then for any A' 7^ there are a. 6 = > 
and measurable Tv C T with fiiTy) > such that p\'(t) > S for all t ETy. 
Hence /(rA') > /^_^, e^PA'Wrf^(t) > ^i{Ty) / e. Then for every A' ^ 0, 

lim^^oo /(rA') = 00. 

There is a compact K C M^^^ with inf / = inf /, for otherwise we could 
find a sequence of unit vectors A'^,, and — > 00 such that lim/j^oo fi^k^'k) = 
inf/; we can also assume there is a unit vector A' such that A';. — ?■ A'. Given 
r > 0, rA'fc = s'A'^ + (1 - s')rkK = r^i (-)■ 1 as A; 00) whence 

/(rA^) < s7(A'J + (1 - s')f{nK). Since''supJ/(rfcA',)| < 00 and / is 
continuous, letting A; —t- 00 we get /(rA') < /(A') which is impossible because 
lim^-i-oo /(rA') = 00. Since inf / is attained on K, sup L will be attained. □ 

The main outcome of Theorem H] and Proposition [5] is the Corollary [6] 
from below, that for small e is an approximate entropy maximization result. 

Corollary 6 Let T cW he a closed subset. Let I C 71^ he finite with G /. 
Fix k G Z+ such that maxjg/ \i\ < 2k + 2. Let {gi)i^i he a set of numhers with 
Qq = 1. Fix also an arhitrary constant e > 0. The following statements (a), 
(b), (c) are equivalent: 

(a) There exist functions f G L]^_(T,dt) such that \f\f{t)dt < 00 and 

jj'f{t)dt = g,, zel; (11) 

(b) There exists a particular solution /* of (11 II) maximizing the functional 

Hif) = H,{f) = - [ f\n fdt-e [ \\tf'+'fdt; 

JT Jt 

(c) The associated Lagrangian L = from helow satisfies sup L < 00 

L{\) = Y,g,\- [ eS»^^^>*'-ll*ll"^'cit +1. 
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In this case: supL is attained in a point A* = {X*)iei, both and X* are 
uniquely determined, —H{f\) = L{\*) and 



m = e 




in particular 



dt = Qi {ie I). 



Proof. Use Theorem H] for a(t) = 1 and p{t) = e ^ (t G T), which 
provides a Lagrangian I/p,a,g and point A*^^ related to the present ones L, 
X* by Lp^a,gW = L{X - A°) and A* = A;'„,^ - A° where A° = (A°)i67 with 
A° = 6io. Then Proposition [5] apphes, since J2iei^i9i = S'o > 0. □ 

By Theorem m one can also cover other cases, like the case T = compact, 
e = [20], see also [1] (setting a{t), p{t) = 1 on T) or, to some extent, 
[Theorems, [9]] setting a (t) = {\\tf+lf,p{t) = c||tf -"(||t||2+l)-3/2 (n>2); 
we omit the details. Another application is Corollary [71 As mentioned in G. 
Blekherman and J.B. Lasserre [9] where a characterization of the feasibility of 
([T]) was obtained, avoiding the entropy maximization but also in Lagrangian 
terms, in principle one could numerically maximize such L's to obtain A*. 

Corollary 7 Let T d R" he closed, k e Z+, I = {i e : \i\ < 2k} and 
{gi)\i\<2k 0. set of reals with go = 1. The statements (a), (b) are equivalent: 
(a) There exists an f & L\ (T, dt) such that 



(b) L{X) := ^|j|<2fc ~ It^ e H*" ^dt is bounded from above. 

In this case, L attains its maximum in a point X* = (A*)|j|<2fc and 



satisfies frpff*{t) dt = Qi < 2k). 

Proof. Use TheoremHJand Proposition [S] for a = + 1, P = e~"*"^. □ 




f*{t) : 



1 
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Notation For g = {g.i)\i\<2k having representing densities on M", let A* = A* = 
i.'K)\i\<2k denote the vector maximizing -Z^o(A) = X]|i|<2fc e^i'i^^fc -^'i* 
Set P,(t) = EK|<2fcA:^'- Then Y.\i\=2kKt' <^ for all teW (use j^^e^^dt <oo 
and polar coordinates). Let G be the set of all such with the property 
Yli\i\=2kK'^^ < for t 7^ 0. Then (see [18j) G is dense and open in the set 
of all g having representing densities, consists of data g for which A* does 
provide a representing density = e^^* of g maximizing H = — j fin fdt, 
and the map G 9 i— t- A* is C°°-diffeomorphic. Let n, k = 2, whence 
card {i : \i\ < 2k} = 15. Let x = {xi)i^z\,\i\<4 denote the variable in M^^. Let 
Go = {geG: det AX* ^ 0} where A = Ax is the matrix in ([17]). Then Go is 
dense and open in G. Given g G G, we may set gj := f Pe^^^^Ut for \j\ > 5. 

Proposition 8 Let n,k = 2 and g^G^. The higher order moments {gj)\j\>5 
of the maximum entropy density e^^ can be expressed by relations of the form 

9j = Y.''^^^^*^9r (JGZ+, |j|>5) 

|i|<4 

where rji = rji{x) are universal rational functions, see ( fTTl) - ( !20l) . 

Proof. It suffices to prove that for any jo ^ ^+ with |jo| > 5 there are 
rational functions Cjgi = Cjgi{X*), for \i\ < \jo\, such that gj^, = Zl|i|<|jo| '^Joidi 
and then proceed inductively. Set |jo| = ^ + 1 for / > 4 and denote A* = 
(A*)|j|<4 by X = (xj)|j|<4. Set = if k ^ 0. Let p = Pg, namely p(t) = 
J2\i.\<4:^i-t''- We will find a polynomial 7i{t) = X]|i|<« Cjoi^* and a differential 
1-form u = e^{udti + vdt2) with m, v polynomials, depending on jo, such that 
du{t) = {P° - 7r(t))eP(*)(iti A dt2. By Stokes' theorem on disks Dr of center 
and radius r, duo = /^^ a; — t- as r — )■ cxd since ue^.ve^ are rapidly 
decreasing {g G G). Hence j^2{t^° — Ti{t))e^^^^dtidt2 = which is the desired 
conclusion. The condition on u means that L = L{u,v) := vdip — ud2P + 
div — d2U where dm = d/dtm ijn = 1, 2) satisfies L = P° — tc. We let u(t) = 
'^\jl=i-2'^jt'' , "vit) = Yli\j\=i~2^3^^ with aj = aj{x),bj = bj{x) rational functions 
to be determined. Set ei = (1, 0), 62 = (0, 1). In degree /+1, the equation L = 
-vr gives E|i|=«--2,M=4,.i>i^j^ia;^^^'^'"'' -Eb|=z-2,k|=4,.2>i«i^2a;.tJ'+'"'' = 
P°. Change the summation indices by i = j + — ei,2 and identify the 
coefficients of P with i > 0, l^l = / + 1. Then 

LlX,bi+ej_-L- ^ L2X,ai+e2-L = (|i|=/ + l) (12) 

kl=4, {ei<t<j+ei) l'-l=4, {e2<t<i+e2) 
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where Sijg is Kronecker's symbol. The summation conditions in the brackets 
from above may be omitted, since the terms outside the respective ranges 
vanish formally due to either li^2 = 0, or aj,bj,x^^ = whenever j,K ^ 0. 
Once we have such u, v, vr is determined from L = P" — vr by gathering all 
terms of degree < / in —L. We solve f lT2|) in the Appendix, that provides 
also an algorithm for computing Cj^i, rji via the formulas ffT7|l - f l2U]) . □ 

Corollary 9 Let n,k = 2 and g,gQ G such that sg + {l — s)gQ G Go for 
all s G [0,1], where go has a known \*^. Set Ti{x,s) = sgi + (1 — s)((7o)i 
for \i\ < 4 and Tj{x, s) = Y.\i\<4i^jii^) {^9i + (1 - ■s)(fi'o)i) for |j| > 5 where 
X = (a;i)|i|<4 G M}^. The system of ordinary differential equations 

5^r,+,(x(.),.)^(s) = ^7,-(^o). (N<4); x(0) = A; (13) 
b1<4 

has a C°° solution x = x{s), defined on a neighborhood of [0,1], the matrix 
[rj_|_j(x(s), s)]|j| |j|<4 is defined and invertible for all s G [0, 1], and we have 

xii) = x;. 

Proof Since Gq is open, the point g{s) := sg + {1 — s)go is in Gq (in 
particular, has representing densities) for every s in a neighborhood of [0, 1]. 
Set g{s) = {gi{s))\i\<4. Since g{s) G G, it has a A* = A*^^) maximizing Lo^g(s)- 
Let x{s) = A*(^). Write x(s) = (x,(s))|,|<4. Then Pg(s)(t) = I]|,|<4a;t(s)f . 
The if-maximization holds and e^s(^) is a representing density for g{s), 

gi{s)= [ fe^N<4"'(^)*'(it (N<4). (14) 

Denote by g{s)j for \j\ > 5 the moments of higher order of e^f^"), namely 
9i^)j '■— I P e^^^''^^^^ dt (|j| > 5). Since the map G 9 ^ H- A? is diffeomorphic, 
x{-) is smooth and we may apply d/ds to the equalities (fT^ . whence 

9^ - = E / t^^^e^H..-W*' ^(.) = Y: 9{sU,^{s). 

By Proposition El g{s)j = Y.\i\<4^jii^i^))9iis) = Tj{x{s),s) (|j| > 5). Then 
we obtain the differential equations f|T3l) on a neighborhood of [0,1]. The 
denominators of rji{x) do not vanish on the set {x{s) : < s < 1} and so 
Ti^j{x{s), s) are defined for < s < 1. Each matrix [^i+j{x{s) , s)]\i\^\j\<4 = 
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[/ f "'"■'e^9(=)*^*-*(it]|j| |j|<4 is positive definite and so invertible. By (fn|) . Qi = 
J t^e^i'i^'*'^'*-^-'* dt < 4). Due to the uniqueness of tlie critical point of tlie 
Lagrangian Lq^ we derive x(l) = A*. □ 

Remarks Since Tj{x{s), s) = g{s)j for |j| > 5 where g{s) = sg + {1 — s)gQ, 
all the entries of the matrix T = [^i+j{x{s), s)]\i\^\j\<4, of the system f[T^ : 
r(a:(s), s) ■ ^(s) = g — go are moments that can be computed inductively by 
linear recurrences g{s)jg = J2\i\<iCjoi{xis))g{s)i (|jo| = / + 1) using Cjj, see 
( IT9l) . ( l20l) : the explicit formulas of r^j are not needed to this aim. Moreover, 
for each / the calculations of gj^ (|jo| = I + 1) are independent of each other. 
We may consider any go E Gq, for instance the set of moments up to the 4th 
order of e~*i~*2. Also fast inversion algorithms exist for such Hankel matrices 
r. Then for problems of reasonable size one can use numerical methods for 
systems of ordinary differential equations to obtain A* (= a;(l)). 

Appendix. The functions rj i We give an algorithm to recurrently com- 
pute rji,Cji, in particular solve f lT2|) to finish the proof of Proposition |8l Set 

4 = 5(i+i-fc,fc)jo for < A; < / + 1. Let ak = a{i_2-k,k), h = 6(/-2-fc,fc) for 
0<k< 1-2. Thus ak, l3k = for k < 0, k > /-I. Also = if k ^ 0. Change 
the summation indices in ( |T2l) by j = i + ei^2 — (> 0). Then ( lT2l) becomes 

Yl,\j\=l-2,{j2<i2) + l)^i~i+ei^i -Yl,\j\=l~2,{j2<i2) -h + l)Xi_j+e2«J = ^ijo 

where the (redundant) condition j2 < 12 follows from j < i, that comes from 
> ei^2- For every i = {I + 1 — k,k) with < < Z + 1, we have the 
equivalence (j > 0, |j| = / — 2, j2 < ^2) j = {I — 2 — p, p) for < p < k 
and hence the I + 1 equations in ( IT2l) become now, respectively, 

k 

^[(4+p-fc)x(4+p_fc,fc_p)/3p-(fc-p+l)x(3+p_fc,fc_p+i)ap] = 4,0<fc</ + l. (15) 

p=0 

If Z > 5, let ao, ■ ■ ■ , a^-s = and define (3o, ■ ■ ■ , Pi-^ inductively by Ax^oPk = 
- Z]p=d(4 + p- k)x(i+p-k,k-p)(3p + 5k {0 < k < I - 5) where Xle := 0. Note 
that 0:40 < since g e G. This fulfills ([15]) for < A; </ - 5. The last 
6 equations in f lT2|) (/ — 4</c<Z + lin f lTSj) ) provide, as we will see, 
C(k, Pk (/ — 4 < < / — 2). If / = 4, skip this step and go directly to the 
linear 6x6 system (which in this case will be f[T7|) for y,z,w = 0). In any 
case, we let now i = {I + 1 — k,k) for < A; < / + 1 in f lT2|) . We have 
i + ei — L = {I + 2 — k — Li, k — L2) and i + 62 — l = {I + 1 — k — Li, k — L2 + 1) . 
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The last 6 equations in (fT^ become 

^Lix,f3k-,2-^^2X,ak^,^+i = 6k (/ - 4 < A; < / + 1). (16) 

|t|=4 |i|=4 

Write equation (1161) for k = l — A. It is then easy to write the next equations: 
we copy the 1st one, increasing each time by 1 the indices k of ctfc, ^fc- The 
brackets ( ) below will border quantities that are already known in terms of 
/3o, • • • , /3/-5- The markers [ ] border sums of terms that are null due to the 
conditions ti,2 = 0, afc, /3fc = (/c > / — 1) or = (0 < A; < / — 5): 

4a;4oA-4 + (3a;3iA_5 + 2x22^-6 + IxisA-? + OX04A-8) 

[-OX4oa/_3] - lX3ia;_4 [-2x22aZ-5 - 3Xi3Q;i_6 - 4Xo4a/-7l = ^/-4 
4x40^-3 + 3X3i/3/_4 + (2X22A-5 + IX13A-6 + OX04A-7) 

[-Ox4oa/-2l - la;3ia;_3 - 2x22a/-4 L-3xi3ai_5 - 4xo4a/-6l = ^i-'i 

4x40^-2 + 3X3iA„3 + 2X22A-4 + (la;i3A_5 + OX04A-6) 

[-Ox4oa/-il - la;3iai_2 - 2x22a«~3 - 3xi3a/_4 [-4xo4««-5l = ^1-2 

[4x4oA-l+l 3X3i/3/_2 + 2X22A-3 + 1X13^-4 + L02;04A-5l 

[-0x40^^ - lx3ia/_i ] - 2x22ai-2 - 3xi3a/_3 - 4xo4a«-4 = (^z-i 

[4X40^ + 3X3iA„i+] 2X22A-2 + 1X13^-3 + [0X04^-4] 

[-Ox4oa/+i - 1x310, - 2x22tt/-i 1 - 3xi3a,_2 - 4xo4az-3 = 5i 

L4x4oA+i + 3x31 A + 2X22A-1+I IX13A-2 + [0^04^-3] 

[-0x400^+2 - lx3i«/+i - 2x22a« - 3xi3a/_i ] - 4xo4a/-2 = ^z+i- 

Set y = -3x31 A-5-2X22A-6-X13A-7, 2: = -2x22A-5-Xi3A-6 and t(; = -Xi3/3/_5. 
We easily read from above that at-, Pk for k = l — 4, 1 — 3, 1 — 2 are given by 



4X40 








X31 










" A-4 




y + 


3X31 


4X40 





2X22 


X31 







A-3 




z + k^z 


2X22 


3X31 


4X40 


3Xi3 


2X22 


X31 




A-2 




W + (5/_2 


Xl3 


2X22 


3X31 


4Xo4 


3Xi3 


2X22 




-tt«-4 









Xl3 


2X22 





4X04 


3Xi3 








Si 








Xl3 








4Xo4 




-a«-2 







(17) 
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(note also that g G Gq). We have a^, 6^, and so -u, f such that deg {L{u, v) — 
P°) < I. Now vr = P° — L is determined by summing the terms of degree < / 
in —L. For m = 1, 2 set Km = {(j, l) : \j\ = I — 2, \l\ < 3,Lm> !}• Then 

U,i-)(^K2 {j,i)eKi \j\=l-2,j2>l \j\=l-2,ji>l 

For any i > with \i\ < I, the coefficient of f in the sum T^Kz from above 
is I]o»Gi^2(i) ^j'^^x, where K2(i) = {(j, t) e K2 : j + l - 62 = i}- The map 
-ft'2(^) 3 (j, I— !■ i — j is bijective onto li := {k > : k < i, \ k\ = \i\ + 2 — I}. 
Then we may use it to change the summation index hj k, = i —j and get the 
coefficient of f in T,k2 as '^i^(zj^{i^2 + l)«i-Ka;K+e2- Similarly, the coefficient of 
f in J^Ki is X^Kg/il'^i + ^)bi-KXK+ei- The coefficient Cj^i (= a rational function 
czj(,i(x) of X, actually) of f in n{t) is then 

'^ioi = + l)a;«,+e2ai-«: - (^^i + ^)x^+eibi^K\ + djoi < I) (18) 

where djgi = {12 + I)ai4-e2 — (^1 + l)fei+ei if N =^ — 3, and otherwise. We have 

930 = 5^ c,oi(x) (IjoI = / + 1, / > 4). (19) 

\i\<i 

Successive compositions of the mapping {gi)\i\<i ^ ((5'jo)bo|=i+i5 i.9i)\i\<i) = 
{gi)\i\<i+i given by f|T9l) for / = 4, 5, . . . provide us with some uniquely deter- 
mined functions rji{x) such that 

^, = ^r,,(x)^7. (|j|>5). (20) 

\i\<4 

Thus ffTTI) - fl^Ul) provide Cjj, r^j. Since det Ax^O and 2:40 = ^|j|^4 Xjt*|i=ei <0, 
the denominators of the rational functions rji do not vanish at x = A*. □ 

It would be interesting to generalize Proposition [8] and Corollary [9] to 
arbitrary n and k, for a class of simple domains T including R", [0, 00)" and 
get rid of assumptions like g E Gq / G, for Lagrangians with e > 0. Also, 
numerical tests of systems like (fT3l) should be done. We hope to obtain more 
applications of the present results in future work. 
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